RNN Based Sampling Technique for Effective Active Learning

نویسندگان

  • Gaurav Maheshwari
  • Bhanukiran Vinzamuri
  • Vikram Pudi
چکیده

In this paper, we address the problem of active learning using the notion of influence sets based on Reverse Nearest Neighbor. Active learning is an area of machine learning which emphasizes on achieving optimal classification performance using as few labeled samples as possible. Reverse nearest neighbors have been used in domains such as clustering and outliers detection in the past effectively. In this paper, we devise a new sampling method for instances based on the knowledge provided from RNN influence sets. To demonstrate the effectiveness of our sampling method, we compare its performance against existing sampling methods on few real life datasets. The experimental results show that our technique outperforms existing methods, particularly on multi-class datasets.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Accelerate RNN-based Training with Importance Sampling

Importance sampling (IS) as an elegant and efficient variance reduction (VR) technique for the acceleration of stochastic optimization problems has attracted many researches recently. Unlike commonly adopted stochastic uniform sampling in stochastic optimizations, IS-integrated algorithms sample training data at each iteration with respect to a weighted sampling probability distribution P , whi...

متن کامل

Paired Sampling in Density-Sensitive Active Learning

Active learning consists of principled on-line sampling over unlabeled data to optimize supervised learning rates as a function of the number of labels requested from an external oracle. A new sampling technique for active learning is developed based on two key principles: 1) Balanced sampling on both sides of the decision boundary is more effective than sampling one side disproportionately, an...

متن کامل

Semi-Supervised Training in Deep Learning Acoustic Model

We studied the semi-supervised training in a fully connected deep neural network (DNN), unfolded recurrent neural network (RNN), and long short-term memory recurrent neural network (LSTM-RNN) with respect to the transcription quality, the importance data sampling, and the training data amount. We found that DNN, unfolded RNN, and LSTM-RNN are increasingly more sensitive to labeling errors. For ...

متن کامل

Exploration of Arak Medical Students’ Experiences on Effective Factors in Active Learning: A Qualitative Research

Introduction:: Medical students should use active learning to improve their daily duties and medical services. The goal of this study is exploring medical students’ experiences on effective factors in active learning. Methods: This qualitative study was conducted through content Analysis method in Arak University of Medical Sciences. Data were collected via interviews. The study started with p...

متن کامل

Active Learning: An Approach for Reducing Theory-Practice Gap in Clinical Education

Introduction: The gap between theory and practice in clinical fields, including nursing, is one of the main problems that many solutions have been suggested to eliminate it. In this article, we have tried to investigate its solution through active learning. Methods: In this review article, searching articles published during 2000-2012 was done through library references, scientific databases. ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2011